Papers by Quoc V Le
BIG-Bench Extra Hard (2025.acl-long)
Copied to clipboard
Mehran Kazemi, Bahare Fatemi, Hritik Bansal, John Palowitch, Chrysovalantis Anastasiou, Sanket Vaibhav Mehta, Lalit K Jain, Virginia Aglietti, Disha Jindal, Peter Chen, Nishanth Dikkala, Gladys Tyen, Xin Liu, Uri Shalit, Silvia Chiappa, Kate Olszewska, Yi Tay, Vinh Q. Tran, Quoc V Le, Orhan Firat
| Challenge: | Current benchmarks for large language model reasoning focus on math and coding abilities, leaving a gap in evaluating broader reasoning proficiencies. |
| Approach: | They propose a benchmark to evaluate general reasoning in large language models . they use BIG-Bench and its harder version BIG-Benefit Hard to assess general reasoning . |
| Outcome: | The new benchmark pushes the boundaries of LLM reasoning evaluation. |
Towards Robust Mathematical Reasoning (2025.emnlp-main)
Copied to clipboard
Thang Luong, Dawsen Hwang, Hoang H Nguyen, Golnaz Ghiasi, Yuri Chervonyi, Insuk Seo, Junsu Kim, Garrett Bingham, Jonathan Lee, Swaroop Mishra, Alex Zhai, Huiyi Hu, Henryk Michalewski, Jimin Kim, Jeonghyun Ahn, Junhwi Bae, Xingyou Song, Trieu Hoang Trinh, Quoc V Le, Junehyuk Jung
| Challenge: | IMO-Bench is a suite of advanced reasoning benchmarks that targets the international mathematical Olympiad level. |
| Approach: | They propose IMO-Bench, a suite of advanced reasoning benchmarks that targets the level of the international mathematical Olympiad. |
| Outcome: | IMO-Bench is a suite of advanced reasoning benchmarks that targets the level of the international mathematical Olympiad. |